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Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

Claims 1-20 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Suyoung Seo and Toni F. Schenk with title of "A study of integration methods of aerial 
imagery and LIDAR data for a high level of automation in 3D building reconstruction" 
dated April 2003, hereinafter Suyoung, and in view of Marc Pollefeys, Luc Van Gool 
with title of "How the virtual inspires the real: From images to 3D models", hereinafter 
Marc. 
Claim 1 

Suyoung teaches a map generation device (see figs. 13-17), comprising: Suyoung teaches 
an image appointment unit (i.e. noted in fig. 13) that receives user appointment of at least one 
position in a building existing (i.e. noted in fig. 17) within an aerial photograph to designate the 
at least one position as part of a building region; Suyoung teaches a polygon extraction unit 
(noted on page 71 section 6.1, see figs. 7-8) that extracts at least one pixel from pixels (i.e. noted 
on page 69 section 4.2), 

Suyoung is silenced about the building region based on a result of discriminating a color of the 
pixels around the building region to compare whether the pixels are within a gray-level variance 
of a predetermined discrimination threshold, sets the building region to include extracted pixels 
as a portion of an extracted building region, and repeats the extract and set operations to expand 
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the extracted building region with more extracted pixels, and then extracts a polygon line of the 
extracted building region; 

However, Marc teaches on page 53 the building region based on a result of 
discriminating a color of the pixels around the building region to compare whether the pixels are 
within a gray-level variance of a predetermined discrimination threshold, sets the building region 
to include extracted pixels as a portion of an extracted building region, and repeats the extract 
and set operations to expand the extracted building region with more extracted pixels, and then 
extracts a polygon line of the extracted building region (i.e. noted under "robustly relating real 
images"); 

Suyoung teaches a vector generation unit that generates a vector of the polygon line of the 
extracted building region (i.e. noted on page 74 in fig. 17 the polygon line around the roof) ; 
Suyoung teaches a structural analysis and integration unit that detect a boundary of the building 
region and lines inside the building region, and compares between a shape of detected lines and a 
predetermined share pattern of cross lines (i.e. noted in fig. 17 initial approximation and 
estimation and the final result, also on page 71 figs. 5-8 illustrate predetermined shape pattern); 
Suyoung obviously teaches wherein the structural analysis and integration unit estimates the 
building region based on the compared shape of the detected lines in a case where the lines 
inside the building region correspond to any predetermined integration patterns, and terminates a 
process for integrating the building structure in a case where there exist no lines corresponding to 
any of the integration patterns, and wherein the vector generation unit generates a vector of the 
polygon line of the extracted building region estimated by the structural analysis and integration 
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unit (i.e. noted in fig. 17 initial approximation and estimation and the final result, also on page 71 
figs. 5-8 illustrate predetermined shape pattern). 

Thus, it would have been obvious to a person skill in the art at the time of the invention to 
combine Marc into Suyoung in order to obtain a depth estimate, or the distance from the camera 
to the object surface, for almost every pixel in an image. The images used for the reconstruction 
can also be used for texture mapping, thus achieving a final photo realistic result. 
Claim 2 

Suyoung is silenced about comprising a roof texture analysis unit that analyzes colors 
around the at least one position to determine sample colors for discriminating, the discrimination 
threshold, and a region searching range, wherein the polygon extraction unit extracts at least one 
of the pixels to be included in the building region based on a result of discriminating a similarity 
between a color of the pixels in the region searching range and the sample colors for 
discriminating. However, Marc on page 53 teaches comprising a roof texture analysis unit that 
analyzes colors around the at least one position to determine sample colors for discriminating, 
the discrimination threshold, and a region searching range, wherein the polygon extraction unit 
extracts at least one of the pixels to be included in the building region based on a result of 
discriminating a similarity between a color of the pixels in the region searching range and the 
sample colors for discriminating (i.e. noted under "robustly relating real images"). 

Thus, it would have been obvious to a person skill in the art at the time of the invention to 
combine Marc into Suyoung in order to obtain a depth estimate, or the distance from the camera 
to the object surface, for almost every pixel in an image. The images used for the reconstruction 
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can also be used for texture mapping, thus achieving a final photo realistic result. 
Claim 3 

Claim 3 is rejected with a similar reason set forth in claim 2, above. 
Claim 4 

Claim 4 is rejected with a similar reason set forth in claim 2, above. Note: Marc on page 
53 discloses that the most challenging issue involves automatically getting initial matches from 
real images. For the computer, an image is just a large collection of pixel intensity values. To 
find corresponding points in different images, an algorithm might compare intensity values over 
a small region around a point. However, not all points are suitable for such comparison. When a 
point cannot be differentiated from its neighbors, it is also not possible to find a unique match 
with a point in another image. Therefore, points in homogeneous regions or located on straight 
edges are not suitable for matching at this stage. The typical approach to selecting interesting 
points uses a feature detector [4] that looks for maximal dissimilarity with neighboring pixels; 
we typically aim to extract 1,000 feature points per image, well distributed over the entire image. 
Claim 5 

Suyoung teaches wherein the polygon extraction unit extracts pixels largely different in color 
from adjacent pixels as edge pixels, determines boundary lines based on the edge pixels, and 
expands the extracted building region to the boundary lines to correct the extracted building 
region (i.e. noted on page 71, section 6.1 by linking edge pixels to edge entities). 
Claim 6 

Suyoung teaches wherein the polygon extraction unit rotates the extracted building region so as 
to set the polygon line of the extracted building region in a predetermined axis direction, and 
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smoothes the polygon line (i.e. noted on page 66 section 3). 
Claim 7 

Suyoung teaches comprising a polygon correction unit that, in a case where the polygon 
line extracted by the polygon extraction unit corresponds to a predetermined linking pattern, 
corrects the polygon line to one of a straight line and lines crossing each other at a predetermined 
angle (i.e. noted in figs. 13-17, see also on page 69 section 4.2 the average angle). 
Claim 8 

Claim 8 is rejected with a similar reason set forth in claim 7, above, (i.e. noted in figs. 13- 

17) 

Claim 9 

Suyoung teaches wherein the structural analysis and integration unit integrates the 
building region at least once by a plurality of inputted positions (i.e. noted in section 6). 
Claim 10 

Suyoung teaches comprising a ground projection unit that, in a case where the aerial 
photograph shows a building obliquely, corrects distortion due to a height of the building, and 
projects a building polygon shape on a ground (i.e. noted as an input data using LIDAR). 
Claim 11 

Suyoung teaches a map delivery method, which is used to deliver a map by associating the map 
created by the map generation device according to claim 1 with the aerial photograph (i.e. noted 
in figs. 13-17, also see the abstract). 
Claim 12 

Claim 12 is rejected with a similar reason set forth in claim 1, above. 
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Claim 13 

Claim 13 is rejected with a similar reason set forth in claim 2, above. 
Claim 14 

Claim 14 is rejected with similar reasons set forth in claims 3 and 7, above. 
Claim 15 

Claim 15 is rejected with a similar reason set forth in claim 6, above. 
Claim 16 

Claim 16 is rejected with a similar reason set forth in claim 7, above. 
Claim 17 

Claim 17 is rejected with a similar reason set forth in claim 8, above. 
Claim 18 

Claim 18 is rejected with a similar reason set forth in claim 10, above, (i.e. noted in figs. 

13-17). 
Claim 19 

Claim 19 is rejected with a similar reason set forth in claim 1, above. 
Claim 20 

Suyoung teaches on page 66 section 2.2 teaches the verification process that is 
implemented by estimating the parameters of the building models, and to increase the robustness, 
multiple resources from aerial images and LINDAR data are incorporated. 
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Conclusion 

Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Javid A. Amini whose telephone number is 571-272-7654. The 
examiner can normally be reached on 8-4pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kee Tung can be reached on 571-272-7794. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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Examiner 
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